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1.  .  Introduction. 

Consider  the  following  problem:  A  "system"  (or  "item",  "instrument", 
etc.)  with  a  "lifetime"  that  has  the  distribution  function  F(t)  is  to  be 
inspected  at  times  t^tg, ...  .  If  inspection  reveals  that  the  system  is 
inoperative,  it  is  repaired  (or  replaced);  otherwise  nothing  is  done. 

The  general  problem  is  to  choose  the  inspection  plan,  i.e.,  the  sequence 
ti,tg, ...  ,  in  an  optimal  way  in  a  suitable  sense.  Results  in  this  con¬ 
nection  can  be  found  in  articles  [4],  [2]  where  further  references  can  be 
found.  In  these  studies  it  is  assumed  that  the  distribution  function 
F(t)  is  known.  Although  this  is  usually  not  the  case  in  practice,  the 
resulting  statistical  questions  have  not  yet  received  much  attention 
(see  m,  p.  112,115). 

In  the  present  paper  the  case  is  considered  in  which  the  system 
has .an  exponential  lifetime,  i.e.. 


(1.1) 


if  t  <  0 
if  t  >  0  , 


with  X(>  0)  an  unknown  parameter,  and  several  adaptive  or  sequential 


inspections  plans  are  proposed.  These  plans  use  information,  as  it 


becomes  available  throufe!.  inspection,  to  estimate  the  unknown  parameter 


X  and  in  this  manner  approach  the  plan  that  would  be  optimum  if  X 
were  known.  This  idea  is,  of  course,  not  newj  it  has  already  been 
used  by  Chernoff  and  others  [3],  [l]  in  their  papers  on  sequential  de¬ 
sign  of  experiments  to  which  this  paper  is  related. 

The  plans  proposed  here  are  of  two  general  types,  viz., 

(i)  plans  based  on  maximum  likelihood  methods, 

(ii)  plans  based  on  refinements  of  the  Robbins -Monro  stochastic  approxi¬ 
mation  method  [8]. 

The  asymptotic  properties  of  these  two  types  of  plans  are  generally  the 
same,  blit  from  a  practical  point  of  view  the  latter  seem  preferable  in 
that  they  are  computationally  simpler  and  involve  storage  of  a  minimum 
of  past  information. 


Unless  otherwise  stated,  we  shall  assume  that  there  exist  known 


constants  X  and  X  with  0  <  X  <  X  <  »  such  that 


(2.1)  X  €  (X,  X)  . 

Many  of  the  results  below  can  be  formulated  and  proved  if  X  is  re¬ 
stricted  only  by  0  <  X  <  »,  but  (2.l)  simplifies  things  considerably 
and  is  not  unrealistic  from  a  practical  point  of  view  in  that  X  may 
be  arbitrarily  small  and  X  arbitrarily  large. 

We  shall  also  assume  that  inspections  and  repairs  are  instantaneous. 

Let  {(1,0.  P)  be  a  probability  measure  space.  All  random  variables 
to  be  introduced  below  will  be  assumed  to  be  defined  on  (ft,  0.,  p),  A 
generic  element  of  ft  will  be  denoted  by  and  we  shall,  follow  the 
usual  practice  of  exhibiting  or  omitting  the  argument  co  on  random 
variables  according  to  convenience. 
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Now  consider  an  inspection  plan  defined  by  specifying  the  inter¬ 
inspection  times 

(2.2)  Ti  =  ,  Tj,  =  t  -t  x  ,  i=2,3, ... 

as  follows.  Let  (Un)  be  an  arbitrary  sequence  of  random  variables 
the  joint  distribution  of  any  finite  number  of  which  does  not  depend 
on  the  unknown  X.  Take  T^  =  max  (0,11^)  and  define  (Tn)  iteratively 
by 

(2.3)  Tn+1  =  mx{0'  fn(Yl'  +  V 

for  n=l,2, . . .  .  Here,  each  Yi,  i^O.,.2, . . .  is  a  random  variable  with 
conditional  distribution  given  (Y^, ...,Yi  ^,T^, . ..,T^}  specified  by 

r  1  vith  probability  e  i 

(2*4>  Yi=i  -XT 

(_  0  with  probability  1-e  i  , 

j.1. 

i'.e.,  Y±  -  0  if  the  i  inspection  reveals  that  the  system  is  inopera 
tive  and  Y±  =  1  otherwise.  Also,  fQ  is  a  real-valued  measurable 
function  of  (Y^, ...,Yn),  functionally  independent  of  X.  Intuitively, 
after  n  inspections,  the  next  inspection  time  Tn+^  depends  on  the 
past  observations  (Y^ ...,Yn)  through  f  while  allows  for 

additional  randomization. 

The  class  of  all  these  inspection  plans  will  be  denoted  by  and 
a  generic  element  of  by  I. 

.  3-  Efeiximization  of  information. 

We  define  the  average  information  obtainable  from  a  plan  I  after 

:.j  . 


n  inspections  by 


E[tx  log  Ln(X-)]2 

n  p 

=  lExf 
1 


=  £  E{T^(l-e  E[(Y^-e  )  |Y^, . .  .,Y^_j>T^, . .  .,T^]) 


n  p  -XT*  -1  -XT* 

-  E£T?(l-e  i)  e  1 
1 

•  2,..  -X.Tx.-1  -XTX 

<  n  (1-e  )  e  , 


p  \m  -VT  _ 

since  the  function  T  (l-e“  )  e  is  maximized  by  T  =  T^.  Thus, 

(3-3)  follows. 

.  Equality  in  (5-5)  is  attained  if  and  only  if  T±  =  a.s.  for 
each 'i,  i.e.,  if  X  were  known,  the  optimal  inspection  plan  in  the 
sense  of  maximizing  J  (l,X.)  for  each  n  and  X  would  call  for  periodic 
inspections  with  inter-inspection  times  T^.  However,  within  the  class  S' 
(i.e.,  when  X  is  unknown)  there  exists  no  optimal  plan. 


In  order  to  choose  among  the  plans  in  we  have  to  use  a  different 

criterion.  Thus,  we  might  require  that  inf  J  (l,X)  be  maximized 

Xe(X,X)  n 

for  each  n,  i.e.,  seek  the  maximin  plan.  From  (3*3)  it  follows  that 
such  a  plan  exists  in  «-^*  and  consists  of  taking  T^  =  T^  for  each  i. 
This  type  of  criterion  does  not  take  into  account  the  information  about 
X  that  becomes  available  as  inspection  proceeds.  Plans  with  this  pro¬ 
perty  can  be  studied  by  using  the  criterion  J(l,X). 

Definition:  An  inspection  plan  I  is  said  to  be  adaptive  (relative 
to  J(l,X))  if 

(3-7)  .  J(I,X)  =  X_1TX(2-XTX)  . 


We  shall  now  define  and  discuss  a  few  adaptive  plans. 

(i)  A  Maximum  Likelihood  Plan. 

The  following  plan  is  denoted  by  ML.  Let  T^  be  an  arbitrary 


number  such  that 


•  T£  '<  %  <  Tx  . 


Having  defined  T, ..... T  and  observed  Y, ..... Y  we  compute  the 
I  n  I  n 

maximum  likelihood  estimate  X  of  X,  i.e.,  if  Y.=l  for  i=l, ...,n 

n  ’  ’  i  ’  ’ 

let  un=X  and  otherwise  let  be  the  unique  solution  of  the  equation 


(3.8) 


n  -XT,  -XT. 

lT(Y-e  ^/(l-e  *)  =  0 

1  1  1 


in  Xj  then 


(3.9) 


Xn  =  max(X,  min{X,nn))  . 


Then  we  take 


(3.10) 


n=l, 2, «... 

Theorem  3-2:  The  ML  plan  Is  adaptive. 

Proof .  We  show  firstly  that, 

(3.11)  X^  ->  X  a.s.  as  n  -» » 
and  for  this  it  suffices  to  show  that 

(3.12)  -» X  a.s.  as  n  ->«  . 

Now 

P{Y  =1,  1  <  i  <  n) 

=  P{Y  =1,  1  <  i  <  n-l)P{YQ=l|Yi=l,  1  <  i  <  n-1) 

-XT 

<  P{Y.=1,  1  <  i  <  n-l)e  1  . 

Iterating  backwards  we  have 

-nXT. 

P{Y  =1,  l<i<n)<e  b  • 

Since  P{Y  =1,  1  <  i  C  °°}  <  P{Y.j=l,  1  <  i  <  n)  for  each  n,  we  have 

(3.13)  P{Yi=l,  1  <  i  <  «)  =  0  . 

Next  let  p.  >  X  and  5  >  0  such  that  (p-X)T^  >  8  and  let 
(3.1*+)  e  =  nt(n-*.)Tu  -  8]  . 

Consider  some  ooeH  and  suppose  that 

(3.15)  P  <  lim  sup  u  (ao)  <  ji  +  e  . 

n  n 


7 


rT*TT' 


mis 


V.  - 


Qi 


I 
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Then  there  exists  a  sequence  (n^)  and  an  integer  k^  such  that  for 
all  k  >  k^ 

*  <  ^<»>  <  ^  *  € 

and,  by  (5*13)  we  may  also  suppose  that  for  some  i  <  Y^co)  £  1. 

Hence,  from  (3*8),  for  k  >  k^, 

\  -u  T  -*i  T. 

0  =  I  VY^e  ^  1V(1-e  “k  *) 


(3.16) 


*k 


"k 


where 


>  i  Tiv(i-e'(,1+e)Ti)  ■  r-^i e  * i(i_e  11  ^ 

=  [T/Ti/(l.e-(^)Ti)  .It/Ni/Vs 

n  1  V  1 


£n  =  I  T1(Yi-e’XTi)/(l-e-(,:i+€)Ti). 

Writing,  temporarily, 

Xi  =  Ti(Yi-e'XTi)/(1-e‘(4+e)Ti)  , 

we  have 

E[Xn|Xi,...,Xn_i) 

=  E{E[Xn|Y1,...,Yn_1,T1,...,Tn3|X1,...,Xn_1) 

=  E(T^(l-e  ^  ^  i)  ^E[(Yn~e  n)  |Y^, . . ., Y^_^,T^, . . .,T^] |x^, . . .,Xn) 

=0  a.s. 

because  of  (2.k).  Also,  . _ 


Var(Xn)  =  E{T^(l-e‘(vi+e:)Tn)"2E[(Yn-e‘XTn)2|Y1, ..  ...'/Pj) 

=  E{T2(l-e"^+e^Tn)"2e"X'Tn(l-e“XTn)} 

<  2X_2(l-e"^+e^,DX)“2 

<  00  . 

Hence,  by  Theorem  E,  p.  387  of  [7]* 

n  -*  0  a.s.  as  n-»»  . 
n 

In  particular,  we  may  suppose  that  for  our  ct, 

(5.17)  nfY  (“)  ->0  as  k  ->». 

*  \ 

The  first  two  terms  on  the  right  in  (3.16)  are 

1  1 

and  using  the  inequalities 

(l-e-iaTi) (1-e- (l1+€)^i)"1  >  (i+e/^)-1 

e-(n-X)T±  <  (l+Cn-XjTj)"1 

this  expression  is  greater  than 

\ 

2  e'XTi  T  [(1+e/p)"1  -  (l+(n-X)T  )-1] 

1  \ 

(3.18)  >  6(|i-X)_1  £  e-Vri 
“  1 

>  nk5(ia-X)-1e"X'\  , 

where  we  have  used  (3*1*0  and  the  fact  that  T^  <  T  <  T^.  Therefore, 
dividing  (3.16)  by  n^  and  letting  k  -»«>  while  using  (3*17)  and 

(3.18) ,  we  get 
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-  t  ■— 


_ i'e- 


"U  T4 


-LI  T. 

"  n  4 


0  =  lim  inf  n^1  |  T^Yj-e  \  i)/(l-e  \  i) 


k-»  as 

>  S(ii-X)'1  e'XTX  >  0 


which  is  a  contradiction.  Hence 


P(n  <  lim  sup  (i  <  |i+e}  =  0  . 


n-»  oo 


'  1  ’  ;  y  |»  •  '  Y :  •  r  — H  XT' 

It  is  also  readily  shown  that  P(lim  sup  n  =  »)  =  0  (in  fact  un  <  T  e  X  a.s.). 


n->  »s 


Thus  it  follows  that 


P('.  <  lim  sup  (i  }  ■=  0 


n->  <w 


n' 


By  a  similar  argument  we  show  that 


P{lim  inf  u  <  X}  =0 


n-»» 


and  these  two  results  yield  (3.12). 

Now,  since  T  is  a  continuous  function  of  X,  it  follows  from 

K 

(3.1l)  and  (3.10)  that  T  -» T.  a.s.  as  n  -»».  Also, 

n  k 

,  ,  -l  “  2  -XT.,  -XT,  -1 

Jn(ML,X)  sEn^^e  i(l-e  i) 

and  hence  it  follows  from  the  dominated  convergence  theorem  that 


.  .  2  -XT,,  -XT,  -1  . 

j(ML,X)  =  T^e  x(l-e  K)  =  X  ^(B-XT^)  , 

concluding  the  proof  of  the  theorem.  It  is  also  possible  to  modify 
Wald's  proof  of  the  consistency  of  the  maximum  likelihood  estimator 

[11]  to  show  that  X  -» X  a.s.. 

n 

(ii)  A  Stochastic  Approximation  Plan. 

The  following  plan  (denoted  by  SA)  is  based  on  the  Robbins-Monro 
stochastic  approximation  method  [8];  it  exploits  the  fact-  that  x\ 
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a  .’7"’ 


corresponds  to  the  lOO(l-p)  £  79'7-th  percentile  Of  the  exponential  dis¬ 
tribution,  independent  of  X..  The  plan  ie  defined  m  follows: 

Choose  ^  arbitrary  in.  and  after  defining  . ,Tr  let 

\  -  -  t;1  los  P  , 

(3.21)  A  =  X'V1  =  -  T  (p  log  p)'1  , 

n  n  n 

and  Tn+1  =  max{T^,  min{Tx>  Tn+n_1An(Yn-p) ) )  , 


(3.25)  Tn(o>)  -» as  n  -»<». 

Let  e(>  0)  be  small  enough  so  that 


11 


(V£>  Ve)  C  {TT^  *l)  • 


There  exists  an  integer  k£  such  that 


T>  V 


(3.2 6) 


|T  (<o)-Tj  <  e/2  for  all  k  >  k£  , 


m+J 

|  X  wj  <  e/4  for  all  m  >  ,  and 

m  e 

all  J  >  0  , 


(n. +i)’1A  +Jt  <  e/4  for  all  k  >  kg  and 

all:  t  >  0  . 


Let  k  >  k  be  fixed  and  consider  the  behavior  of  T  ,  m=0, 1,2, .. 

G  D.  *rlu 

Suppose  T  -T.  >0  (a  similar  argument  will  hold  otherwise) .  From 
nk  X 

(3-21) 

-XT 

T  -  T,  =  T  -  T.  +  (e  "k  .  "XTX)  +  W 

n+1  X  n-  X  "k  a  -e  ix 


<  T  -  T.  +  W  <e. 
\  X  ”k 


If  T  "  TX  >  tlien  repeating, 
"k 


T  . _  -  T.  <  T  -  T.  +  W  .+  W  <  e  . 

V2  x"  \  x  \  V1" 


Repeating  this  argument  we  find  that  if 


T  -  T..  >  0  for  m=0, 1, . . .,4-1 
n,  +m  X 


It  ,  -  T,  |  <  e  for  nt=0, 1, . . . ,  4-1  . 

1  n,  +m  X 1  '  ’ 


Suppose  that  T  <  0.  Then 

°k  -  *  ~ 
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0  >  T  ,  .  -  T. 

—  n,+£  X 

*  -XT 

■  TVi-i  -  \  +  IV^Vj-iI*  .  *  “v<- 1 

>  -  (vMl-^,.1  +  “V/.! 

>  -  e/2  . 

Now  we  apply  the  same  argument  but  starting  with  T  instead  of  T 

It  follows  that,  for  all  m, 


l\+»  -  Txl  <e  - 


and  (3*25)  follows. 


To  conclude  the  proof  of  the  theorem  we  shall  now  show  that  for 

almost  all  co,  T.  is  a  limit  point  of  the  sequence  {T  (03)}.  Fix 
a.  n 

u)  and  let  (T  }  be  a  subsequence  converging  to  Tq,  say,  with 
r 

T  e  [Tr*,  T.  ] .  We  shall  suppose  that  T  >  T^ ,  the  other  case  being 
O  A  A  O  A 

similar. 

Let  e(>  0)  be  such  that  T.+e  <  T  -e.  There  exists  r  such 

A.  O  € 


s  It  -  T  I  <  e/2  for  r  >  r  , 
•'no1'  e  ' 

r 

m+j 

|  £  W±|  <  e/k  for  m  >  nr  ,  J  >  0 


(3.27)  (nr+i)  An  +1  <  for  >  V  >  0  • 

r 

-XT,  -X(T +e) 

Let  c  =  e  -e  .  Then,  from  (3«2l),  for  r  >  r 


.  T  , ,  -  T,  <  T  -  T.  -  cn’^A  +  W 
n  +1  X  -  n  X  r  n  n 
r  r  r  r 

If  T  -  T,  >  e,  then  we  repeat  to  obtain 
nr  1  X  - 
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T  ,0  -  T.  <  T  -  T.  -  c[n  ‘'"A  +(n  +l)-1A  , .  ]  +  W  +  W  . 

n+2  X  —  n  X  r .  n  r  '  n  +1  n  n  +1 

r  r  r  r  r  r 

If  again  T  -  T,  >  e,  we  repeat  as  before;  since  V  (n  +m)“^A  ,  = 

r  m  r 

it  follows  that  there  exists  an  integer  £  such  that  T  . -  -  T.  <  e 

n  +/J  a,  — 
r 

while  T  . 4  ,  T.  >  €.  Then,  from  (3.21) 
n  +£-±  a.  — 


i.e.. 


T  -  T,  >  -  (n  +i-l)  A  +  W  .  .  .  >  -e  , 

n  +£  X  —  r  n  +jb-1  n  +i-l  — 

r  r  r 


T  ,  .  -  T.  <  €  . 
1  n  +£  X1  - 
r 


Hence,  for  each  e  there  exist  k  such  that  |t^-T^|  <  €,  i.e., 

{T  ]  ’  has  a  11  ml  law-  point  at  T. ,  and  the  theorem  follows, 

n  x 

As  far  as  the  criterion  j(l, X)  is  concerned,  the  ML  and  SA  plans 
are  equivalent;  however,  the  plan  leading  to  a  sequence  (T^)  which 
converges  fastest  to  seems  preferable  in  that  this  plan  would 

generally  lead  to  the  largest  average  information  Jn(i,X)  for  finite  n. 
One  possible  way  to  judge  the  rate  of  convergence  of  (Tn)  is  to  con¬ 
sider  the  variance  of  the  asymptotic  distribution  of  (T  -T. ) .  The 

n  a. 

asymptotic  distributions  of  /n  (T  ~T^)  for  both  plans  considered 
[ML  and  SA]  are  given  in  the  next  theorem. 

Theorem  3.k:  For  both  the  ML  plan  and  the  SA  plan,  we  have 


(5.28) 


/n  (VTx)  -*N(0,(i-p)p-1X"  ) 


(3.29) 


S*  (X  -X)  £  N(0,  (l-p)p_1T"2)  , 


2 

where  N(p,  a  )  denotes  the  normal  probability  law  with  mean  and 


variance  o  . 


Proof.  First  consider  the  ML  plan.  Substituting  nn  for  X  in  (3.9) 
we'  have 

n  -XT.  -u  T.  -U  T 

(3-30)  I  T ,(e  i-e  n  i)/(l-e  .  n  i)  +  |  =  0 

1  1 

where 

n  -XT.  -U  T. 

In  «  I  We'  i)/(1"e  n  1)  * 

By  a  central  limit  theorem  for  non-independent  random  variables  such  as 
Theorem  C,  p.  377  of  [73>  or  Lemma  6,  p.  377  of*  [9]  or  Lemma  4,  p.  238 
of  [10],  we  have 

(3.31)  n"l/2|n‘iN(0,Tx2e  ^(l-e’^)'1)  a  NtO^pd-p)’1^)  . 

Since  l-e-X  =  x[l+g(x)]  where  g(x)  ->0  as  x  -» 0,  (3-30)  can  be 
written 

I  ^  o  “XT  — u  T.  “1  *i  /q 

(3.32)  ^n-X)n  iT^e  1(l-e  n  i)  [l+g(  (^-X)^)  ]  =  -nVln  . 

Since 

n  ?  -XT  -n  T  -1 

n  ITie  i(1'e  n  *)  [H-g((^n-X)Ti)]  -»• 

o  "XT%  —1  p  _  "i 

T^e  ^(l-e  )  s  T^p(l-p)  a.s.  as  n  -»<»  , 

(3.30)  and  (3«29)  yield 

/£(nn-x)  iu{0,(l-v)v~\2)  . 

Writing  /n(Xn~X)  =  /n(|Jn-X)  +  e1  ,  it  follows  from  (3.10)  and  (3.12) 
that  -» 0  a.s.  (in  fact  e^n  =  0  for  n  large  enough).  Hence 

^n(X  -X)  and  /n(un-X)  have  the  same  asymptotic  distributions. 
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Since 


dT 

Q1X  .-2  . 

d r  =  x  l0” 


r  —  a-. 

n  X 


we  obtain  also 

^(VV->(°^(i-P)p"\V^p)2) 

which  is  equivalent  to  (3.28). 

Now  consider  the  SA  plan.  Since  Tn  -*  and  Tj-  <  there 

exists  a  random  variable  N  with  P(N  <<*>)=!  such  that,  for  all  n  >  N, 


*X  <  Tn  +  n'  Wp)  <  TX 


and  hence,  by  (3-21),  for  n  >  N  , 


Vi "  T»  ♦  VV»>. 


(5.32) 


-1  ,  -NIL  -MP, 

=  T  +  n  1A  (e  n-e  K)  +  W 


-  T„  -  ■>' *  Wn 


where  €gn  -» 0  a.s.  as  n  -*■<». 


Multiplying  (3*32)  by  (n+1)7,  rearranging  terms  and  writing 


temporarily 


we  have 


xn  *  -7<  W  ’ 


(3-33) 


X  A  =  X  -n_X(l-7+e,  )X  +  ( n+l)\ 
n+1  n  3n  n  n 


where  -> 0  a.s.. 

3n 


1 


If  7  <  1/ 2,  then  the  argument  we  used  to  show  that  T  -T,  -» 0 

n  a. 

with  Tn  .defined  by  (3-2l)  can  be  applied  to  the  sequence  {Xn)  as 
given  by  (3.33)  to  show  that  Xn  -» 0  a.s.  as  n  -+»;  hence 


(3-34) 


T  -T.  =  o(n_y)  a.s.,  with  y  <  if 2,  as  n  -»«  . 


Again,  from  (3.3s) 


(3-35) 


”<WV  ■  (-l)(W  +  +  “"n 


where 


e4n  "  ‘WW  = 


as  n  -*».  By  (3>34) 
(3-36)  I 


|e^  |  =  0(n~  ')  a.s.  as  n  -»<*>. 


Iterating  (3*35)  back  to  n  =  N+l  and  dividing  by  /n  ,  we  get 
(3.37)  ^(Tn+i-\)  =  n_l/2N(TN-Tx)  +  n’l/2  f  +  n'1/2  f  k  W  . 


and,  by  (3*36) 


n  1//2N(TN-TX)  -+0  a.s.  as  n  -+», 


-1/2  n 

\  £  ei,v  -» 0  a.s.  as  n  -t®  . 

N+l  K 


Also, 


and  here 


-1/2  2  -1/2  r  -1/2  H 

n  £  k  W  =  n  '  £kW  -n  J  k  W 


n  '  k  W,  ->0  a.s.  as  n  +®. 

1  ;  k 

While  by  the  central  limit  theorem  from  which  (3*31)  follows,  we  have 
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if1/2  £  k  W 4  N(0,  (l-p)p' V2)  . 

.  1 

These  results  together  with  (3-37)  yield  (3-28)  and  conclude  the  proof 
of  the  theorem. 

Since  the  two  plans  have  the  same  asymptotic  distribution  we  are 

unable  to  decide  between  them  on  this  basis.  From  a  practical  point  of, 

view  the  SA  plan  seems  preferable.  It  is  not  only  computationally 

simpler  but  on  each  step  only  the  values  of  Tn  and  Yq  are  required 

in  order  to  calculate  T  whereas  the  entire  past  set  of  observations 

n+1 

is  required  in  the  case  of  the  ML  plan. 

An  important  question  at  this  point  is  whether  one  could  construct 

an  adaptive  plan  with  a  smaller  asymptotic  variance  for  /n(T  -T.  ) 

n  a. 

than  that  of  the  plans  discussed.  We  state  the  following  theorem  ([6]) 
without  proof. 

Theorem  3.5-  For  any  plan  I  such  that  there  exists  a  sequence  of  posi- 

tive  numbers  fa  (X))  such  that  a  (X)  -» 0  as  n  -»<»  and 
-  n  - - —  n  —  - 

an(X)_1(Tn-Tx)  4  N(0,1) 

(which  implies  that  I  is  adaptive),  we  have 

lim  inf  na  (X)2  >  (l-p)p_1,X-2 
n-»  oo  ~ 

for  all  Xe(X,  X),  except  possibly  for  X  in  a  set  of  0  Lebesgue 
measure . 

This  theorem  states  that  it  is  essentially  not  possible  to  improve 
on  the  ML  and  SA  plans  if  the.  criterion  used  is  the  asymptotic  variance 
of  /JT  (Tn-Tx). 
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it-.  Minimization  of  cost. 


We  shall  now  suppose  that  maintenance  of  the  system  involves  the 
following  costs:  Each  inspection  costs  c^  units;  repair  of  the  system 
if  it  is  inoperative  costs  Cg  units;  and  while  the  system  is  inopera¬ 
tive  a  cost  of  c,  units  per  unit  time  is  incurred.  In  this  section  we 
shall  study  the  problem  of  choosing  the  inspection  plan  so  as  to  minimize 
the  long  run  expected  cost  per  unit  time. 

More  precisely,  consider  a  plan  I  giving  rise  to  inter-inspection 

times  (T. }  with  associated  inspection  times  t  =  T  .  Over  the 

1  1  3  <  i  J 

interval  [0,t]  the  cost  associated  with  plan  I  is 

nt  N. 

(4.1)  e  H  +  c  l  (1-Y  )  +  c  (  l  V  +  W )  , 

1  T  *1=1  1  ?i=l 


where  N  is  defined  by 

T 


(4.2) 


tN  -  T  <  tN  +1  ' 

X  T 


and  where  V±  denotes  the  time  the  system  has  been  inoperative  over  the 

interval  [ti  ^,t^ ]  and  WT  the  time  it  has  been  inoperative  during 

[t  ,t].  Hence, the  expected  cost  per  unit  time  over  the  interval  [0,x] 

T 

associated  with  plan  I  is 

N 


i  T  i 

(4.3)  C(I,X,t)  =  t_XE  J  Ic^gd-YjJ+CjVj  +  T'xc5EWt 


We  also  write 

(4.4)  C(I,X)  =  lira  sup  C(I,X,x )  . 

n-» « 

Within  the  class  no  inspection  plan  exists  having  the  property  that 
C(I,X,t)  is  minimized  for  each  x  uniformly  in  X.  We  shall,  therefore, 
use  C(l, X)  as  a  criterion  for  evaluating  inspection  plans.  This 


■  T 


9 


;> 

i 

i 


criterion  is  closely  related  to  one' suggested  "by  Flehinger  [4], 
Theorem  4.1:  For  each  X  and  for  each  I  , 


(4.5) 

where 


*-l  -XT^ 

C(I,X)  >  c3  +  Tx  (c^d^  (l-e  x)] 


=  c„  -  c,X 


-1 


(4.6)  d^  -  i*2  -  v'j‘ 

and  T*  is  the  unique  solution  of  the  equation 

(4.7) 


e  (1+XT)  =  1  +  c  d^  ; 


if  X  <  ^/(c^+Cg)  then  0  <  T*  <  °°  , 
if  X  >  Cj/C^+Cg)  then  we  take  TJ  =  " 

and  in  this  case  the  second  term  in  (4.5)  should  he  interpreted  as  0. 

Proof.  Consider  a  fixed  r  and  define  variables  X^  by 

i 


(4.8) 


Xi 


1  if  I  T  <  T 
0  otherwise  . 


Then  (4.3)  can  be  written 

-i  “  l 

(4.9)  C(I,X,t)  =  Y  xi Cc1+c2(1-Y1)+c5V13  +  T  c3EMt 


Now 


=  t  X  E  Xi[ci+c2(l'Yi)+c3Vi]  +  T"  c3EWt  * 

.  EtX^l-Y^]  =  E{E[X.(l-Y1)|Y1,-...,Yi_1,T1,...,Ti3) 

=  E(XiE[(l-Yi)|Y1,...,Y11,T1,...,T1]) 


■XT. 


=  EtX^l-e-  *)}  , 


and  similarly, 
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z&tz?  ~  ~t .* ..  ^V“.,  .  Sr.  ;  .  i \‘>r. 


*  -XT 

E  X±Vi  =  E  Xi{TjL-X‘1(l-e  *)) 

“  .1  -X(T  -  I  XiTi) 

E  WT  =  E(T  -  Y  1(l-e  1  1  1  )) 

Substituting  into  (4.9),  we  find 

oo  -XT 

(4.10)  C(I,X,t)  =  Cj+T-1  l  E  X1[c1+dx(l-e  1 )] 

-X(T-fxT) 

.  -  CjX-1T-1E(l-e  1  1  1  )  . 


-VT, 


If  X  >  c^Ac^j+Cg),  then  ^td^  >  0,  which  implies  that  c^^+d^Cl-e  *)  >  0. 
Hence,  dropping  the  second  term  on  the  right  in  (4.10),  we  obtain 

C(I,X,t)  >  Cj-CjX'V1 

and  (4.5)  follows  by  letting  t  -»».  in  the  remaining  case  X  <  Cj/(cj+c2) 
which  implies  c^+d^  <  0*  T^le  function  T  tc^+d^(l-e"'  )]  is  minimized 

by  taking  T  =  T*,  and,  using  (4.7),  this  minimum  value  becomes 


(4.11)  T*'1[c1+dx(l-e  *)]  =  (c1+dx)x(l+XT*)‘x  <  0  . 

From  (4.10) 

-XT* 

C(I,X,t)  >  Cj+T*"J'[c1+d^(l-e  A')]t_x  £  ET^-c^t 

and  using  the  inequality 

00  oo 

t'x  £  EX  T  =  Et"  £  X  T  =  Er  ^  >  T,  <  1 
1  1  1  1  1  1 

together  with  (4.1l)  we  have 

-XT* 

(4.12)  C(I,X,t)  >  c5+T^'1[c1+dx(l-e  x)]  -  c^’V1 


-XT* 

Ky 


V-l 


-1-1 


N 

,  T 

Et’  I  T  < 
1  1 


from  which  (4.5)  follows  by  letting  t  -*°o. 
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Equality  in  (4.5)  is  achieved  if  T  =  T*  a.s.  for  all  i,  so 
that,  if  X  were  known  this  would  constitute  an  optimal  inspection  plan. 
A  few  properties  of  T*  as  a  function  of  X  are  worth  noting. 

T£  is  continuous  for  0  <  X  <  Cj/fc^+Cg)  and  — » +  °°  as  X  -»0 

or  Cj/Cc^+Cg).  Also  T*  is  hounded  helow  hy  a  positive  constant)  in 
fact,  since 

-XT* 

e  X  >  1-X.T* 

it  follows  from  (4.7)  that  - 

2  *2  -1 

!-X  T*  <  !  +  Ci^  . 


i.e 


*  > 


(4.13) 


^  ,  .  -2. -1.3/2  _  -1 

>  (‘C1X  \  )  ^  clc3 


for  X  <  c^/  (c^+Cg).  Since,  for  X  >  Cj/tc^+Cg),  T*  =  «>  (4.13)  holds 
for  all  X.  The  general  form  of  T*  is  indicated  in  the  following 
figure 


Intuitively  speaking,  when  X  is  small,  the  system  fails  infre¬ 
quently  so  that  one  would  expect  that  the  hest  inspection  plan  would 

require  infrequent  inspections;  that  is  in  accordance  with  the  behavior 

•  •  ’•  *»  ,  .  \ 

of  T*  -as  X  -»0.  Also,  if  X  becomes  large,  the  system  would  be 

K  .• 

failing  at  a  high  rate.  If  this  rate  is  high  enough,  one  would  expect 


that  it  would  be  more  economical  to  abandon  the  system  and  sustain  the 
cost  Cj  per  unit  time  rather  than  to  try  to  maintain  the  system. . 
Again,  this  is  in  accordance  with  the  behavior  of  T*  as  X.  increases 
and,  in  fact,  the  critical  value  is  X  =  c^/Cc^+Cg). 

Now  we  turn  to  the  case  where  -  X  is  unknown. 

Definition:  An  inspection  plan  I  is  said  to  be  adaptive  (relative  to 

c(i,x))  if 


(4.14) 


C(l,X)  =  c5  +  Tj"1[ci-hlx(l-e  *)]  . 


XT* 
A,\ 


Next  we  exhibit  and  discuss  two  adaptive  plans. 

(i)  A  Maximum  Likelihood  Flan.. 

Let  (sn)  be  an  increasing  sequence  of  positive  numbers  such  that 


and 


(^•15) 


s  -* a>  as  n  -»» 
n 


n  -Xs 

lim  inf  n~  £  e  1  >  0 
n->  <»  1 


for  all  Xe(X,X)  and  some  ae(l/2,l).  As  an  example  of  a  sequence 
satisfying  these  conditions,  we  mention 


sn  =  s  +  P  log  n 

where  s  >  0  and  p(>  0)  is  such  that  XP  +  a  <  1. 

Now  we  define  the  following  plan.  Take  ^  =  s1;  after  n  steps 
compute  the  maximum  likelihood  estimate  X^  of  X  and  then  take 

(4.i6)  Tn+1  =  min(sn+1,T*  }  . 

n 

We  shall  denote  this  plan  again  by  ML  but  it  should  be  noted  that  it 
differs  somewhat  in  spirit  from  the  ML  plan  of  section  J.  The  differences 


are  due  to  the  fact  that  we  have  no  a  priori  upper  hound  on  T*.  In 

fact,  if  we  had  defined  T  ,,  =  T*  then  X  >  c,/(e.,+e/!>)  for  some 
’  n+1  X  n  —  3  1  2' 

n 

n  (which  has  positive  probability  of  occurring  even  if  X  <  cy^e^+Cg)) 
would  imply  T  -  =  °°,  resulting  in  no  further  inspections  and,  in 
general,  non-adaptivity  of  the  inspection  plan.  Hence  it  is  necessary 


to  control  the  rate  at  which  (Tn)  can  increase  and  this  is  the  purpose 
of  the  sequence  { ) . 


Theorem  4.2:  The  ML  plan  is  adaptive. 


Proof.  First  we  prove  again  that  [X^]  is  a  strongly  consistent  sequence 
of  estimates- of  X,  i.e., 


X  -*  X  a.s.  as  n  — > . 
n 

This  result  is  proved  by  the  following  slight  modifications  of  the  argu¬ 
ment  given  in  the  proof  of  Theorem  3-2.  By  exactly  the  same  reasoning 
as  that  leading  to  (3.17)  we  obtain 


(4.17) 


it  01  |  (cd)  -» 0  as  k  -*< 
■k  JX, 


The  lower  bound  on  the  first  two  terms  on  the  right  of  (3-l6)  given 


by  (3.l8)  is  replaced  by 


(4.18) 


1^4  -Xs, 
a(u-X)"1  \  e  1 
1 


in  which  we  have  used  the  fact  that  c^cj  £  which  follows 

from  (4.13)  and  (4.16). 

Hence,  dividing  (3.16)  by  n^  and  letting  k  ->  «  while  using 

(4.17)  and  (4. 18)  together  with  (4.15)  we  again  obtain  a  contradiction. 

It  follows  that  X  -» X  a.s.  as  in  Theorem  3-2.  This  implies  that 
n 
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■a  tan 


3 

'l 

.! 


. . . :.ft , 


suitable  inspection  plans  using  stochastic  approximation  methods  becomes 
more  difficult.  We  shall  discuss  such  a  plan  using  a  sequence  of  estimates 
of  X  based  on  a  stochastic  approximation  method  closely  related  to  that 
used  to  estimate  in  section  3*  The  relation  between  these  methods  will 
be  indicated  below. 

Let  (s  }  again  be  an  increasing  sequence  of  numbers  such  that, 


for  all  Xe(X,X) 

(4.19) 


r~  -2  2Xsn 
n  e  n  <  m 

n 


and 


s  — » oo  as  n  — » oo 
n 


An  example  of  a  sequence  satisfying  these  conditions  is  again 

s  =  s  +  p  log  n 
n 

where  s  >  0  and  f3  is  such  that  0  <  20  X  <  1. 

Now,  let  Tn  =  s.  and  let  X  be  arbitrary  in  the  interval 
(X,X).  Having  defined 

*,Tn'  ^i»  ‘  we  let 

-X  T 


and 

(4.20) 

where 


Xn+1  =  I^(i>^n(x>xn-n"'LBn(Yn-e  n  n))) 


Tn+i  =  min(s  ,T*  ) 

n+1 


B  =  T'1  e  n  n 
n  n 


We  shall  denote  this  plan  by  SA.  In  older  to  see  the  relation  be¬ 
tween' this  plan  and  the  SA  plan  of  section;  3  defined  by  (3»2l),  let  us. 
ignore,  for  the  moment,  the  truncation  of  (Tn)  to  the  interval  [T^, ] . 
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- - - - ft  — 


By  (4.19) 


I  Var(Wn)  <  «  , 


■  n 


and  It  follows  again  from  Theorem  D,  p.  387  of  [7]  that  ^  converges 
a . s . .  Further, 


1  .  ,  Xs 

-It,  -1  -1  n  « 

n  B  <  n  c,c,  e  -» 0  as  n  -»« 
n  —  3  1 


and,  for  X  -X  >  e, 

7  n  — 


,  -XT  -X  T 

r-  -I,,  /  n  n  n, 

1  n  HBn(e  -e  ) 

•  -XT  (X  -X)T 

Z-l_  n  n,  n  7  n  , , 
n  jBne  (e  -1) 

,  -X  T 

>  S  n-1B  e  n  n  e  T 
—  *-  n  n 


>  «  1  n 


-1 


With  these  three  facts  in  hand  an  analog  of  the  proof  of  theorem 
3.3  can  he  given  to  show  that  Xn  -» X  a.s.  as  n  -•»<».  We  shall  not 
give  the  details  again. 

One  possible  way  to  compare  adaptive  plans  is,  as  in  section  3,  to 
compare  the  asymptotic  distributions  of  Tn  and  choose  that  with  the 
smallest  asymptotic  variance. 

Theorem  4.4:  For  both  the  ML  and  the  SA  plans  we  have 

(i)  if  X  <  Cj/ic^+Cg)  then 

£  XT*  ,  dT*  o 

/n(Tn-T*)  -N(0,(e  X-l)  (tJ-1  ^)2) 

and  - 

XT* 

y^(Xn-X)  is(0,(e  X-1)T*‘2)  i 
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sufficiently  large. 


Proof,  (i)  For  the  first  part  the  proof  is  quite  analogous  to  that  of 

Theorem  3*4  and.  we  omit. the  details. 

(ii)  Since  -» X.  >  cy'Cc.y-Cg)  a.s.,  we  have,  for  all  n 

sufficiently  large, 

T*  =  co  i.e.,  T  =  min(s  ,T*  )  =  s 
X  n  n  X_  n 

n  n 

This  theorem  indicates  that  these  two  plans  are  again  asympototically 
equivalent  and  the  SA  plan  seems  to  be  preferable  only  in  that  it  involves 
somewhat  simpler  computations .  It  is  still  true  that  the  SA  plan  requires 
the  calculation  of  T*,  thus  requiring  the  solution  of  equation  (4.7).  at 

A. 

each  step.  It  is  possible  to  introduce  a  plan  that  will  also  simplify 
this  calculation  by  using  an  approximation  method. 

At  present  it  is  not  known  whether  the  two  plans  considered  have  an 
optimum  property  of  the  type  possessed  by  the  equivalent  plans  in  the 
previous  section  as  indicated  by  Theorem  3*5 • 

5.  Extensions . 

We  are  now  considering  the  extension  of  these  results  along  the 
following  lines: 

(i)  Replacement  of  the  exponential  distribution  by  a  more  general 
failure  distribution. 

(ii)  Other  types  of  cost  functions. 

(iii)  Constraints  on  the  inspection  times. 

This  list  obviously  does  not  exhaust  all  possibilities. 


« 
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